Hadoop环境下基于SparkSQL海量自动站数据查询统计初探     

黄志  詹利群  任晓炜  李涛 《气象科技》2019,47(5):768-772

在Hadoop分布式计算和存储架构下,自定义ETL数据清洗规则将海量自动站小时单站文件按所属年和站号合并为大文件流转存储至HDFS中,并运用SparkSQL并行计算框架进行统计处理生成常用气象要素日统计值。结果表明,数据处理和获取时效较关系型数据库方式有显著提升。采用SparkSQL并行计算框架对多气象要素多站点和长时间序列进行数据统计处理查询均能达到秒级别响应,并随着统计站点数的不断增加和时间跨度的延长其优势更为明显,能更高效地支撑此类气象数据服务,为海量气象数据处理从关系型数据库到大数据分布式架构的转换处理提供了新思路。  相似文献   

东北地区气温演变的一致性与局地性特征研究     

侯依玲  刘鸣彦  赵春雨  王涛 《气象与环境学报》2019,35(2):69-76

选取中国东北区域162个气象站1961—2015年地面气温资料,采用多种统计方法分析了近55 a东北地区气温的一致性和局地性演变特征。结果表明:东北地区年平均气温存在较为良好的空间一致性,"全区一致型"气候类型为东北地区最主要气候形态;第一旋转载荷向量时间系数呈上升趋势亦存在较明显2—7 a的周期,说明北部地区气温受全球变暖、ENSO等大尺度气候背景影响显著; 1961—2015年北部区域以0. 34℃/10 a的升温率高于南部区域的0. 26℃/10 a,但1980年后增温趋势减慢;年平均气温的概率曲线随年代整体向高值区移动,北部区域冬季增暖较为显著,南部区域冬夏均较为明显,春秋季节可能有缩短趋势。  相似文献   

喀拉海和巴伦支海海冰对中高纬异常纬向环流暨中国东部重霾天气形成的作用          下载免费PDF全文

陈诚  牛涛  陆尔 《大气科学学报》2019,42(2):267-279

采用1981年1月—2017年2月国家气象信息中心雾、霾数据集资料、同期NCEP/NCAR再分析资料以及哈德来中心的海冰资料,分析了秋冬季喀拉海和巴伦支海海冰变化与东亚冬季风暨中国东部冬季雾和霾日数变化特征之间的关系。研究结果表明,喀拉海和巴伦支海海冰对亚洲区中高纬纬向环流有重要影响,秋季海冰异常偏少是冬季亚洲区中高纬异常纬向环流形成的诱因之一。该地区秋季海冰偏少年,冬季亚洲中高纬地区纬向环流异常偏强,东亚大槽偏弱,影响我国东部地区的东亚冬季风减弱,这为大气污染物在水平方向上的聚集提供了有利条件,同时在海冰偏少年,对流层从中层向下均为正温度距平,与地表温差减小,不利于对流发展,使得大气的状况变得更加稳定,不利于大气污染物在垂直方向上的扩散,水平和垂直方向上的共同作用导致中国东部地区易发生霾天气过程。虽然喀拉海和巴伦支海海冰是影响中国东部地区冬季霾过程发生的重要因子之一,但其对冬季中国东部雾天气发生日数多寡的影响并不显著。亚洲区纬向环流指数相比经向环流指数更能反映中国东部地区冬季雾-霾日数的变化,冬季亚洲中高纬纬向环流越强,中国东部地区雾-霾日数越多。  相似文献   

CCSM4模式对东北气温和降水的模拟及预估   总被引：1，自引：0，他引：1  

张海娜  侯依玲  赵春雨  刘鸣彦  王涛  周晓宇  崔妍  敖雪  易雪 《气象与环境学报》2019,(1):72-78

利用东北地区162个气象观测站逐月气温和降水资料对CCSM4模式的模拟性能进行了评价,并预估了2021—2050年东北地区的气候变化情景。结果表明:CCSM4模式长期历史气候模拟实验模拟的1961—2005年月平均气温、降水量值能较好地再现东北区域年平均气温、降水量的空间分布形态,但气温模拟值比观测偏低,91. 4%站点误差在1. 5℃以内;降水中心比观测略偏北,全区平均偏多35. 18 mm。2021—2050年东北区域年平均气温呈增温趋势,高纬度地区的增温幅度明显大于低纬度地区,与基准年相比,RCP2. 6、RCP4. 5和RCP8. 5情景下全区分别偏高6. 00℃、5. 86℃和6. 42℃。年降水量分布呈东南向西北递减的形态,降水大值中心出现在东南部吉林与辽宁交界处,RCP2. 6、RCP4. 5和RCP8. 5情景下全区分别偏多15. 2%、3. 1%和2. 0%。  相似文献   

FY-3 A/MERS I积雪制图中NDS I指标建立及积雪判识模型研究 ——以祁连山区为例     

韩涛  王大为  李丽丽 《冰川冻土》2018,40(3):511-527

我国新型自主的极轨气象卫星风云3号A星（简称FY-3A）上搭载的中分辨率光谱成像仪（MERSI）为大面积雪监测提供了新的遥感数据源。以中国西北祁连山区为例,分析FY-3A/MERSI传感器积雪与其它地物的图谱特征差异,建立了适用于FY-3A/MERSI的归一化差分积雪指数（NDSI）,以此为基础,构建了综合利用多光谱判别指标及土地覆盖类型（LULC）定类辅助的积雪判识模型,生成250 m分辨率的日积雪制图产品。模型通过逐步逼近的树状判别结构,去除了易和积雪混淆的部分乔木林、云、云阴影、水体、湖冰、沙（盐）地等地物,并提出应考虑积雪下覆地表特性的影响,调整设定不同LULC类型的积雪判别阈值约束,实时结合区域LULC影像进行积雪的最终判定与优化。对祁连山区2010-2011年积雪季FY-3A/MERSI影像的积雪制图应用结果表明,该资料能够客观精细地反映积雪的空间分布与动态发展过程。同时利用气象台站积雪观测记录及Terra/MODIS积雪判识结果进行对比验证,结果表明基于FY-3A/MERSI建立的积雪判识模型具有较高的精度和稳定性,特别是提高了云雪区分的效能。  相似文献   

The First Discovery of the Easternmost Jehol Biota from Southeastern Jilin,China     

LI Yunfeng  HUANG Wei  WANG Hongshan  David L. DILCHER  TAN Xiao  LI Tao  NA Yuling  SUN Chunlin 《《地质学报》英文版》2018,92(4):1649-1650

正Objective The Jehol Biota,a world-famous Early Cretaceous fossil Lagerst?tte characterized by the traditional Eosestheria-Ephemeropsis-Lycoptera(EEL)assemblage,has a wide distribution over most parts of northern China,the coastal area of southeastern China,southeastern Mongolia,Transbaikalian area of Russia,Korea and Japan(Shao et al.,2017).The Baishan Basin,situated in  相似文献   

新疆四顶黑山花岗岩体锆石LA-ICP-MS U-Pb年龄及地质意义          下载免费PDF全文

王静  王学武  邓明国  孙涛 《地质找矿论丛》2018,33(3):365-374

新疆东天山位于中亚造山带南缘,天山—兴安造山系北天山造山带东段,发育大量泥盆纪—石炭纪花岗岩,其形成过程多与觉罗塔格洋的俯冲作用有关。四顶黑山花岗岩体位于东天山觉罗塔格构造岩浆带的东端,岩体在地表呈不规则状产出,侵位于元古界片岩-变火山岩、奥陶系变玄武岩和泥盆系雀儿山群火山岩;主要岩石类型为花岗岩和花岗闪长岩。花岗岩的LA-ICP-MS锆石U-Pb年龄为380.4 Ma±3.7 Ma,表明岩体形成于晚泥盆世。岩石表现出高硅(w(SiO_2)=64.87%~74.71%)、高碱(w(K_2O)=3.35%~4.68%,w(Na_2O)=2.26%~3.85%)、富铝(w(Al_2O_3)=11.82%~14.13%)和低MgO(w(MgO)=0.56%~2.12%)、CaO(w(CaO)=1.68%~3.74%)、TiO_2(w(TiO_2)=0.26%~0.57%)、P_2O_5(w(P_2O5)=0.01%~0.19%)特征,A/CNK=0.83~1.00;富集Ba、K、La、Ce、Nd,亏损Th、Nb、Ta、Sr、Ti,铕负异常较明显(δEu=0.70~0.73);具有岛弧型花岗岩特征。四顶黑山花岗岩体形成于岛弧环境,属于觉罗塔格洋向南俯冲过程中的产物。四顶黑山花岗岩体两侧的镁铁-超镁铁质岩体的形成时代应晚于晚泥盆世。  相似文献   

Carbon Isotope Excursions and Paleo-Oceanography of the Ordovician–Silurian Boundary Carbonate Rocks from the Xainza Area, Tibet     

YUAN Tao  YI Haisheng  ZHANG Shuai  CAI Zhanhu  LI Gaojie 《《地质学报》英文版》2018,92(5):2052-2054

  相似文献   

Tectono–Thermal Evolution, Hydrocarbon Filling and Accumulation Phases of the Hari Sag, in the Yingen–Ejinaqi Basin, Inner Mongolia, Northern China     

YANG Peng  REN Zhanli  XIA Bin  TIAN Tao  ZHANG Yong  QI Kai  REN Wenbo 《《地质学报》英文版》2018,92(3):1157-1169

This work restored the erosion thickness of the top surface of each Cretaceous formations penetrated by the typical well in the Hari sag, and simulated the subsidence burial history of this well with software BasinMod. It is firstly pointed out that the tectonic subsidence evolution of the Hari sag since the Cretaceous can be divided into four phases: initial subsidence phase, rapid subsidence phase,uplift and erosion phase, and stable slow subsidence phase. A detailed reconstruction of the tectonothermal evolution and hydrocarbon generation histories of typical well was undertaken using the EASY R_0% model, which is constrained by vitrinite reflectance(R_0) and homogenization temperatures of fluid inclusions. In the rapid subsidence phase, the peak period of hydrocarbon generation was reached at c.a.105.59 Ma with the increasing thermal evolution degree. A concomitant rapid increase in paleotemperatures occurred and reached a maximum geothermal gradient of about 43-45℃/km. The main hydrocarbon generation period ensued around 105.59-80.00 Ma and the greatest buried depth of the Hari sag was reached at c.a. 80.00 Ma, when the maximum paleo-temperature was over 180℃.Subsequently, the sag entered an uplift and erosion phase followed by a stable slow subsidence phase during which the temperature gradient, thermal evolution, and hydrocarbon generation decreased gradually. The hydrocarbon accumulation period was discussed based on homogenization temperatures of inclusions and it is believed that two periods of rapid hydrocarbon accumulation events occurred during the Cretaceous rapid subsidence phase. The first accumulation period observed in the Bayingebi Formation(K_1 b) occurred primarily around 105.59-103.50 Ma with temperatures of 125-150℃. The second accumulation period observed in the Suhongtu Formation(K_1 s) occurred primarily around84.00-80.00 Ma with temperatures of 120-130℃. The second is the major accumulation period, and the accumulation mainly occurred in the Late Cretaceous. The hydrocarbon accumulation process was comprehensively controlled by tectono-thermal evolution and hydrocarbon generation history. During the rapid subsidence phase, the paleo temperature and geothermal gradient increased rapidly and resulted in increasing thermal evolution extending into the peak period of hydrocarbon generation,which is the key reason for hydrocarbon filling and accumulation.  相似文献   

Geochemical and Petrological Studies on the Early Carboniferous Sidingheishan Mafic–Ultramafic Iintrusion in the Southern Margin of the Central Asian Orogenic Belt, NW China     

SUN Tao  QIAN Zhuangzhi  THAKURTA Joyashish  YANG Shenghong  XU Gang  DUAN Jun  GAO Bo  WANG Jing 《《地质学报》英文版》2018,92(3):952-971

The Sidingheishan mafic-ultramafic intrusion is located in the eastern part of the Northern Tianshan Mountain, along the southern margin of the Central Asian Orogenic Belt in northern Xinjiang autonomous region of China. The Sidingheishan intrusion is mainly composed of wehrlite, olivine websterite, olivine gabbro, gabbro and hornblende gabbro. At least two pulses of magma were involved in the formation of the intrusion. The first pulse of magma produced an olivine-free unit and the second pulse produced an olivine-bearing unit. The magmas intruded the Devonian granites and granodiorites.An age of 351.4±5.8 Ma(Early Carboniferous) for the Sidingheishan intrusion has been determined by U-Pb SHRIMP analysis of zircon grains separated from the olivine gabbro unit. A U-Pb age of 359.2±6.4 Ma from the gabbro unit has been obtained by LA-ICP-MS. Olivine of the Sidingheishan intrusion reaches 82.52 mole% Fo and 1414 ppm Ni. On the basis of olivine-liquid equilibria, it has been calculated that the MgO and FeO included in the parental magma of a wehrlite sample were approximately10.43 wt% and 13.14 wt%, respectively. The Sidingheishan intrusive rocks are characterized by moderate enrichments in Th and Sm, slight enrichments in light REE, and depletions in Nb, Ta, Zr and Hf. The ε_(Nd)(t) values in the rock units vary from +6.70 to +9.64, and initial ~(87)Sr/~(86)Sr ratios range between 0.7035 and0.7042. Initial ~(206)Pb/~(204)Pb, ~(207)Pb/~(204)Pb and ~(208)Pb/~(204)Pb values fall in the ranges of 17.23-17.91,15.45-15.54 and 37.54-38.09 respectively. These characteristics are collectively similar to the Heishan intrusion and the Early Carboniferous subduction related volcanic rocks in the Santanghu Basin, North Tianshan and Beishan area. The low(La/Gd)_(PM) values between 0.26 and 1.77 indicate that the magma of the Sidingheishan intrusion was most likely derived from a depleted spinel-peridotite mantle.(Th/Nb)_(PM)ratios from 0.59 to 20.25 indicate contamination of the parental magma in the upper crust.Crystallization modeling methods suggest that the parental magma of the Sidingheishan intrusion was generated by flush melting of the asthenosphere and subsequently there was about 10 vol%contamination from a granitic melt. This was followed by about 5 vol% assimilation of upper crustal rocks. Thus, the high-Mg basaltic parental magma of Sidingheishan intrusion is interpreted to have formed from partial melting of the asthenosphere during the break-off of a subducted slab.  相似文献